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Abstract. 

Tracking the origin of the accelerating expansion of the Universe remains one of the most challenging research 
activities today. The final answer will depend on the precision and on the consistency of data from future surveys. 
The sensitivity of these surveys is related to the control of the cosmological parameters errors. We focus on 
supernova surveys in the light of the figure of merit defined by the Dark Energy Task Force. We estimate the 
impact of the level of systematic errors on the optimisation of SN surveys and emphasize their importance deriving 
any sensitivity estimation. We discuss the lack of information of the DETF figure of merit to discriminate among 
dark energy models and compare the different representations that can help to distinguish ACDM from other 
theoretical models. We conclude that all representations should be controlled through combined analysis and 
consistency checks to avoid biases. 
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1. Introduction 

The discovery of the acceleration of the Universe is one of 
the most intriguing questions in astrophysics today and 
has been the driver of many theoretical developments try- 
ing to find an explanation for this acceleration. These 
models introduced in general a new component called 
dark energ y ( "the DE mode l s" ) whose nature is unknown 
(see e.g., Peebles fc Ratral , l20Q3t iPadmanabhan . l2003t 
ICopeland et al.1 . 20061) . Their comparison to observational 
data is complex and the experimental interpretation would 
benefit from a 'model independent approach'. The strat- 
egy is not unique today and is linked to the definition 
of the cosmological parameters, in particular those that 
describe the properties of the dark energy component. 

Many studies concentrate on the equation of state 
{w = pressure/density ratio) of this new component. For 
a cosmological constant, w is equal to —1 but it can be 
different and/or can vary with time in other DE models. 
A common way to introduce the time dependence of DE 
models is to use a redshift dependent parameter ization 
such as (iLindeil . l2003t IChevallier fc Polarskil l200l[ ) : 



a being the scale factor. The function w(z) is a good 



observable with adequ ate properties (jLindei 
iLinder fc Hutereii [2003 ) . 



2004a 



On the theoretical side, one needs to estimate whether 
this parameterization is sufficient to describe DE mod- 
els whatever the so urce of the accelera tion is. This ha s 
been investigat ed by Lindeil (|200 6a) ; B arger et al. I (l2006li : 
Linder ( 2004bh who show that this parameterization can 



w{z) ^ Wq + WaZ/ (1 + z) — Wo + (1 - a)Wa 



(1) 



* "Centre de Physique Theorique" is UMR 6207 - "Unite 
Mixte de Recherche" of CNRS and of the Universities "de 
Provence", "de la Mediterranee" and "du Sud Toulon- Var"- 
Laboratory afliliated to FRUMAM (FR 2291) 



represent a large class of models, even those that have 
no real dynamical component. Nevertheless, there are still 
some potential biases when estimating the effective wq 
and W g parameter s from the actual theoretical phase space 
(iLind er. 2006a; Si mpson fc Bridld . l2006i . 

On the experimental side, many new probes have 
shown their ability to constrain w{z). To estimate the sen- 
sitivity of an experimental survey, named " a data model" , 
one needs to define figures of merit (FoM), related to 
the statistical error of the w{z) parameters. This can be 
used to compare and test different experimental strategies. 

The aim of this article is to compare the information 
provided by the various FoM calculated for Supernova 
(SN) surveys. In particular, we distinguish FoM needed 
to compare data models from FoM needed to distinguish 
between and separate DE models. In section 2, we define 
the generic SN surveys used as data models in this article. 
In section 3, we recall the definition of the FoM used by 
the Dark Energy Task Force (.DETfI . l2006h and use it to 



2 



J.-M. Virey, A. Ealet: Sensitivity and figures of merit for dark energy supernova surveys 



compare the sensitivities of the data models. We optimize 
the total number of SN, TV, and the redshift depth, Zmax, 
of the survey in light of the systematic errors. In section 4, 
we compare the impact of different FoM to distinguish the 
source of the cosmic acceleration among the DE models. 

2. Generic supernova data models 

The sensitivity of future surveys depends on several 
experimental parameters. One concern is to well estimate 
their uncertainties. For this purpose, we concentrate here 
on Supernova surveys. We define generic SN data models 
that are representative of future data : 

&) N = 2000 and Zmax = 1: such a survey is close to what 
can be reached from the ground in the near future. Using 
the DETF terminology, this will be our definition of a 
"stage 2" data model. 

b) N= 15000 and z^ax = 1: this is achievable from the 
ground with wide coverage. We call it a "stage 3" data 
model or a "wide" survey. 

c) N=2000 and Zmax = 1-7: this needs an infrared 
coverage which implies a space mission. This will be 
possible at a later stage and we will define it as our " stage 
4" or a "deep" survey. 

d) N= 15000 and Zmax — 1-7: this is postponed to the 
future and we will define it as a "stage 5" or a "wide and 
deep" survey. 

Comparison of the potentialities of theses data models 
should describe the expected improvement on the con- 
straints of the DE equation of state with the characteris- 
tics of the survey. We focus in particular on the relative 
importance of increasing the total number of SN (N) col- 
lected against the redshift depth (zmax)- The feasibiliy of 
a deep or a wide survey is strongly correlated to the ex- 
perimental strategy and is a driver of future surveys. To 
address this, we will keep the other parameters identical 
for all the data models. We use the following hypothesis 
for the cosmology: 

— a ACDM model, 

— a flat universe, 

— a strong prior, as expected from Planck : Qm — 
0.27±0.01. The central value has been chosen to be in 
agreement with the WMAP-3 year data analysis. 

We add the following assumptions: 

— we add a sample of nearby supcrnov ae as expected 



2004h 



from the SN Factory survey ( Woo d-Vasev et al. 
corresponding to 150 SN at z=0.03 and 150 at 0.08. We 
call it the "nearby sample" in the following. 
The intrinsic magnitude dispersion is assumed to be 
0.15. The corresponding "statistical error" of a redshift 
bin is Siristat = 0.15/V-^bin- We have assumed redshift 
bins of width Az = 0.1. 



The level of systematic errors will appear as a fun- 
damental ingredient in the data model comparison (it 
is true for a ny a nalysis as i t has been emphasized by 
DETFI (|2006l) and iKim et al] (|2004l )). We define the sys- 
tematic error by an extra term Suisyst in the magni- 
tude. The total error on the magnitude to(z) is then 
yst ■ Unless otherwise specified, we use 
an uncorrelated error in redshift bins. We have also esti- 
mated the effects of a redshift dependent error (i.e., corre- 
lated in redshift bins) with different amplitudes. Adding 
a redshift dependence does not change our conclusions on 
errors. It is the amplitude of the systematic errors, what- 
ever the form, that has a strong impact on the future 



precision (|Kim et al.l . 120041 ) 



We study the two cases with and without this sys- 
tematic term. Since many papers still provide analysis 
with statistical errors only, we start with this assumption 
{Suisyst = 0) in our study. We then choose a default value 
of Snisyst = 0.02 for the systematic case. This choice is 
an optimistic estimation of the experimental systematic 
errors. The motivation is that using 2000 SN, this system- 
atic error value is already roughly of the same size as the 
statistical error and is a limiting factor of the total error. 

Higher systematic error values, more realistic, provide 
similar conclusions when compared to the statistical case. 
Only the parameter error values are different. 

These two "academic" scenarios illustrate the impact 
of a small systematic effect when statistical errors are at 
a percent level. 

To perform the simulations we adopt a standard 
Fisher matrix approach which allows a rapid estimate of 
th e parameter errors following the procedure described 



( 2004[ ). We use the freely available tool 



in IVirev et al 
"Kosmoshow"0. 



The redshift distribution used in this stud y is based on 
the SNAP prescription from lKim et al.l (|2004l ). The "stage 
4" data model has exactly this distribution. For other data 
models with different N and/or z^ax we have scaled the 
distribution, truncating it at z^ax — 1 when relevant and 
multiplying the remaining number of SN by the adequate 
factor B 

3. Supernova data model sensitivity 

We study the potential of the previous four generic data 
models in term of coverage and statistics, with and with- 
out systematic errors. We examine the interpretation of 
the pivot redshift and of the FoM defined by the DETF. 



"Kosmoshow" 



available 



at 



http://marwww.in2p3.fr/renoir/Kosmoshow.html 

^ For example, for "stage 2", we take the initial distribution 
{N =2000 SN up to Zmax = 1.7) up to Zmax = 1, this selects 
1171 SN then we multiply the number of SN in each redshift 
bin by 2000/1171 to obtain the desired A'' = 2000 total number 
of SN. Then, we get the stage 3(5) distribution by multiplying 
by 7.5 the number of SN of the stage 2(4) distribution. 
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The impact of a systematic error on the sensitivity of these 
surveys is emphasized. Finally, we give some insights to 
the optimization of z„iax and N. 

3.1. The DETF figure of merit 

Recently, the DETFIDETJ], l2006f) has proposed a FoM 
derived from the definition of the pivot point. The pivot 
parameterization is defined as : 

Wa Wa 



o 
> 



w{z) = Wp + [ap — a)wa 



1 + Zp 1 + z 



(2) 



and is equivalent to the paramete rizat i on gi ven in eq.l. 
The pivot redshift Zp is defined by (|HuI . |2005|) : 



Zp Chjquj^ 



(3) 



where Cwgwa is the correlation between wq and Wa and 
<j{wi) is the error on t he parameter Wj. 

It has been shown (jMartin fc Albrechtl . l2006f ) that the 
{wo,Wa) and {wp,Wa) contours are mathematically equiva- 
lent. In fact, Wp is directly related to wq and Wa through a 
linear transformation : Wp = w{zp) = wq + WaZp/ (1 + Zp). 
Consequently, any volume in phase space is conserved. 
This change of definition is convenient to determine the 
mathematical redshift Zp where the function w(z) has the 
smallest statistical error since parameters are decorre- 
lated (this corresponds t o the so-called "sweet-spot 
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Fig. 1. Evolution of Zp for the data models with (bullets) 
and without (stars) systematic errors. 



e.g.. iHuterer fc Turner] (|200l[) ). Note that Zp has been DE dynamics) and should not be used for any comparison. 



shown to be analy sis depe n dent a n d has then no real 
physi cal meaning (iLinder . l2006b : Martin fc AlbrechO . 



20061) . Note also that the error on Wp is equivalent to the 



one obtained on w when we fix a constant 



(as often 



done in previous work in the literature) since Wp and Wa 
are decorrelatcd. 



The DET F FoM is defined as {cj{wp) x cr(wa)]" 
( DETFI . 20061) and is proportional to the inverse of the 
area of the error ellipse enclosing the 95%CL in the wq- 
Wa plane. In the following, we use this DETF FoM or a 
ratio of it, where the normalization can change from case 
to case. We study and show how this FoM can compare 
data models. We then examine h ow this FoM ca n help to 
discriminate DE models (see also Linder ( 2006bl )). 



3.2. Evolution of Zp 

Figure 1 gives the evolution of Zp for the four data models 
under consideration, with and without systematic errors. 
Zp ranges from 0.14 to 0.27 and is sensitive to the system- 
atic errors and the data model. We have also studied the 
variation of Zp when changing the SN nearby sample, the 
Qfn prior or the fiducial cosmology. We find, for instance, 
that the statistics of the SN nearby sample or the Qm prior 
have a stronger impact on the Zp value than the variation 
of Zmax- We conclude that Zp varies in the range to 0.5 
and the variations are neither physical nor intuitive. This 
study has confirmed that this parameter is not represen- 
tative of any physical characteristic of a survey (or of the 



Wp then can be ambiguous as corresponding to differ- 
ent redshift values for each data model. The contours in 
a plane where Wp is one of the two variables (e.g., the 
{wp,Wa) or (fl„i,Wp) planes) will be more difficult to in- 
terpret and should be taken with caution when comparing 
surveys with different characteristics. However, there is no 
ambiguity with the DETF FoM, as it corresponds to the 
area of the error ellip ses which is i dentical in the planes 
(wp, Wa) and (wq, Wa) ( DETFI . 20061 ). Similarly, Wp can be 
used to exclude a cosmological constant when compared 
to —1 (but other observables are maybe more efficient, see 
section 4). 

3.3. Tfie DETF figure of merit for the SN data models 

The DETF FoM for the four data models are shown in 
figure 2. Stars correspond to calculations with statistical 
errors only and bullets when a systematic error of 0.02 is 
included. 

The strong impact of the systematic error term 
appears very clearly in figure 2. First, we observe a strong 
reduction of the FoM value when systematic errors are 
included. Secondly, we see different variations of the two 
cases, when increasing the size of the survey (N) or the 
survey depth (zmax)- 

With statistical errors only, a large statistical sample 
yields a better FoM than a deep survey as can be seen in 
the stages 3 and 4. The relative improvement of stage 3 
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Fig. 2. DETF figure of merit with (bullets) and without 
(stars) systematic errors. 



to stage 2 is of the order of 2.0, whereas it is only 1.3 for 
stage 4 relative to stage 2. In other words, a stage 3 (wide 
survey) provides a sensitivity 55% better than a stage 4 
(deep survey). This indicates that it is better to increase 
N rather than Zmax after stage 2. 

Concerning the stage 5 data model, there is also a 
strong improvement of the FoM. It increases by 30% 
(100%) compared to the stage 3 (4) data model. 

With systematic errors, the conclusion is reversed and 
stage 4 has a far better potential than stage 3. We see in 
figure 2 an improvement of the order of 56% for stage 4 
relative to stage 3. 

The relative improvement of stage 3 to stage 2 is 
now only of the order of 1.15 compared to 1.75 for stage 
4 to stage 2, showing it is now preferable to increase 
Zmax rather than N after stage 2. 

Concerning stage 5, the improvement relative to stage 
4 is only of 18% which is moderate compared to the 
technical complexity of such surveys. 

For other values of systematic errors, these results are 
confirmed : 

— With systematic errors higher than Snisyst — 0.02, the 
difference between stages 3 and 4 steepens (i.e., the 
FoM ratio increases) which reinforces the need for a 
deep survey. 

— Stages 3 and 4 are equivalent, if both have some sys- 
tematic errors of the order of 0.006. Below this value 



a wide survey (stage 3) is better, and above it a deep 
survey (stage 4) is preferable. 

If we keep Snisyst — 0.02 for stage 4, then the system- 
atic errors of stage 3 should be controlled at a better 
level than 0.012 to be more efficient than stage 4. 
Using a redshift dependence for the error gives similar 
conclusions, only the various quoted values will slightly 
change. 

The relative merit of stage 5 compared to stage 4 or 
stage 3 is very dependent on the level of systematic 
errors assumed in the analysis. 



The latest SN data from iRiess et"aL ( 2006[ ) can be 
interpreted as an improvement of the FoM of the order of 
5. Then a stage 2 or 3 survey with a level of systematic 
Srusyst = 0.05 will not improve the current result and 
may be considered as useless. Only an improvement of 
the systematic level can help. The limitation of stage 4 
and 5 is a systematic error of 8%. 

Consequently, the control of the level of systematic er- 
rors is the key parameter to discriminate between future 
wide and deep SN surveys. This is understandable since 
the statistical error soon will be dominated by these sys- 
tematic errors. Our conclusions are valid to quantify the 
impact of systematic errors but give no estimate on the 
methods needed to derive such a level of control. A large 
sample should help in understanding systematic errors and 
its size will depend essentially on the SN properties. In the 
next section, we perform a more detailed analysis of the 
optimisation between TV, Zmax and the systematic errors. 

3.4. Optimization of the survey depth 

Linder fc Huterer (|2003h have emphasized that "the 
required survey depth depends on the rigor of our 
scientific investigation" . They show that it is mandatory 
to have z > 1.5 to reduce cosmological and DE models 
degeneracies when systematic error are included to avoid 
wrong precision and biased results. 

In this section, we optimize the depth Zmax using the 
figure of merit on data models that have a fixed number of 
SN but a different Zmax- We move Zmax by steps of size 0.1 
equivalent to the redshift bin size of our SN distribution. 

For each adjacent model, we compute the ratio of the 
FoM defined for the model at Zmax to the one at an adja- 
cent redshift bin of z^ax — 0.1 : 



R = 



FoM^ 



{a{wa)a{wp)y 



-0.1 



FoM^ 



-0.1 



{a{wa)cr{wp)y 



(4) 



In figure 3, we plot this ratio for the two statistics 
N = 2000 and N = 15000, with and without systematic 
errors. If adding a new redshift bin does not improve the 
errors, the ratio is close to one. The gain is defined by the 
difference to 1. 

The four curves of Fig. 3 show the same behaviour and 
a large improvement is seen when increasing Zmax, up to 
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Fig. 3. Evolution with Zmax of the DETF FoM ratio as- 
suming either N = 2000 or TV = 15000 SN and for the two 
cases with and without systematic errors (plain (dash- 
dotted) curve : systematic case with 15000 (2000) SN, 
dashed (dotted) curve : statistical case with 15000 (2000) 
SN). The FoM ratio is defined for adjacent 2;-bin (see text). 



a plateau where the gain start to be small. If we take a 
5% gain (the horizontal line in Figure 3) as the minimal 
improvement we can accept for an increase of the survey, 
wc can estimate an optimum for Zmax- 

- with systematic errors of 0.02 and A'' = 15000 (plain 
curve) Zmax = 1-7 (the vertical line corresponds to 

Zmax 1-7), 

- with systematic errors of 0.02 and N = 2000 (dash- 
dotted curve) the change is small and Zmax ~ 1-65; 

- with statistical errors only and N = 15000 (dashed 
curve) Zmax is strongly reduced at 1.15; 

- with statistical errors only and N = 2000 (dotted curve) 
one gets z^ax ~ 1-25. 

Surprisingly, the statistical case has a relatively 
small dependence on TV. This comes from cancellations 
in the Zmax evolution of the Wa and Wp constraints, 
which exhibits strong variations with N but in opposite 
directions. 

This can be better understood by plotting directly 
the FoM (not the ratio). Figure 4 shows that the FoM 
increases with Zmax and also with N. With systematic 
errors, the FoM is not strongly dependent on N whereas 
with statistical errors only, the variations due to N are 
stronger than the ones due to Zmax- For example, one has 
the same FoM (90) for N=2000 with Zmax = 1-7 and for 
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Fig. 4. The DETF figure of merit (unnormalized) as a 
function of Zmax with the same labels as fig. 3. 



N=15000 with Zr, 



0.7. 



We deduce from this study : 

— When the systematic errors are neglected, N is the fun- 
damental parameter and Zmax around 1 is sufficient to 
derive strong constraints on the dark energy equation 
of state. 

— If systematic errors are of the order of Smgyst = 0.02, 
a SN sample at z > 1 is mandatory to increase 
the constraints that can be reached from the ground 
(e.g., stages 2 and 3) whatever the statistical size. 

— Beyond z > 1.7, the improvement is marginal (less 
than 5% by redshift bin of size 0.1). This result is 
weakly dependent on N but dependent on Smgyst- 

— A survey with a higher level of systematic errors re- 
quires a higher Zmax 

and has a reduced dependency 

on N. 

— If we introduce systematic errors with a redshift de- 
pendency (a correlation between bins) , the conclusion 
is identical to the constant case and the optimal Zmax 
depend on the larger systematic error value. 

Thus, wc see that for any realistic surveys, it will be 
more important to have a coverage beyond z=l to be able 
to control the precision than to increase the statistics. This 
is an important driver for any future SN survey. 

4. Comparing Dark Energy models 

We want to address not only the statistical sensitivity of 
the SN surveys but also their capability to separate Dark 
Energy models. More precisely, we would like to know if 
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a particular DE model is in agreement with the standard 
ACDM model. Then we need to test the compatibility of 
the two models. The DETF FoM is only one number and 
does not allow us to answer this question. For example, 
Linder has shown ( Linderl . l2006bf ) tha t the key discrimi- 
nant fo r thawing (freezing) models fsee lCaldwell fc Linder 
( 2005f ) for model definitions) is the long (short) axis of the 
{wo.Wa) ellipse . 

Consequently, contour plots should provide more 
information than the DETF FoM and/or the pivot point 
to interpret data. Wc have looked in more detail at the 
different information to estimate the most useful FoM 
when we compare DE models. 

The information is contained in the following FoM: <t{wo), 
o'(wa), o-(wp), cr(wo) X o-{wa), a{wp) X a{wa), the two- 
dimensional {wQ,Wa) contours and the redshift function 
'w{z) with its error shape a{w{z)). We do not consider 
contours with Wp since they are mathema tically equiva- 
lent t o the contours with wo instead ((Martin fc Albrech^ . 

and multiple Wp contours are difficult to interpret 
(see section 3.2). 

The study of the variations of the different errors, as 
we have done in the previous section for the DETF FoM, 
is particularly interesting in comparing data models. The 
individual variations of wq , Wa and Wp do not provide any 
supplementary information to that given by the DETF 
FoM. The behaviours of a(u;o), <j{wa) and the DETF FoM 
are very similar. Only cr(wp) behaves very differently as 
it has a very weak dependence on data models, in par- 
ticular it has almost no dependence on Zmax (see fig. 3 of 
Linder fc Hutereil (|2003l )). 

To compare DE models, in addition to the errors 
we also need the central values of the cosmological 
parameters. We focus now on two different FoM : contour 
plots in the {wojWa) plane and some representation of 
w{z) with error shape variations with the redshift. 

Figure 5 gives the 95% CL contours in the {wQ,Wa) 
plane for the four data models with systematic errors. 
We see two sets of contours, the larger ones with the 
data models with z^ax < 1 and the smaller ones with 
Zmax > 1, a result already obtained from the DETF FoM. 
(Adding in this figure the curves corresponding to the 
pure statistical cases for the four data models allows us 
to recover the results of section 3.3, however the resulting 
figure is not easily readable.) 



s° - 




Fig. 5. 95% CL contours in the {wo,Wa) plane for the four 
data models with systematic errors. The labels of the DE 
models are given on the plot (with a small shift of model 
D for clarity). Stage number for the data models are given 
on each contour. 

increase the constraints on "thawing" ( "freezing" ) models 
we need to reduce the long (short) axis of the ellipse. 
However, to optimize such constraints we need to know 
which parameters control the long and short axis (and 
their directions) of the contour. To understand what 
is important in a survey to improve the discrimination 
among DE models, we introduce four phenomenological 
models defined by their (wo^Wa) pair of values (see Table 
1) and which are at the boundary of the 95% CL of 
the stage 4 data model. We study the variation of the 
constraints for these DE models for the four data models. 



DE model 


wo 




parameters 


z-region 


A 


-0.82 


-0.2 


Wp 




B 


-1.27 


1.15 


Wo,Wa 


\ow-z & high-2 


C 


-0.85 


-1 


Wa 


high-2; 


D 


-0.75 


-0.95 


Wo 


low- 2 



Table 1. Definition and properties of tie DE models 
taken for illustration. The "parameters" ("z-region") col- 
umn gives the cosmological parameters (the redshift re- 
gion) which are the most efficient to distinguish the DE 
model from a cosmological constant. 



The advantage of the (wQ,Wa) contour representation 
is the possibility to "directly" define some classes of DE 
models in this plane. Several recent works have been 
devoted to this subject (Barger et al., 2006; Linder, 
2006a; see also Caldwell fc Linder, 2005; Scherrer, 2006; 
Chiba, 2006, for DE model trajectories/locations in the 
(w,w' = dw/dlna) plane). Consequently, in fig. 5 we 
can represent the different classes of models and study 
their compatibility with ACD M in each dat a model. 
In this way, Linder has shown ( Linder . 2006b| ) that to 



Model A is close to the border of the thawing region 
and, from fig. 5, we see it will be difficult to exclude this 
model even at stage 5. On the other hand, the exclusion 
of models B, C and D is improved with better surveys. 

It appears that the sensitivity to the data models 
is higher along the larger axis. Consequently, the op- 
timization of future SN surveys are able to reduce the 
degeneracy among wq and Wa which is represented by 
a reduction of the long axis, whereas it has almost no 
impact on the short axis. This conclusion should be 
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Fig. 6. Reconstructed w{z) and the associated errors for 
the four data models with systematic errors. The errors 
correspond in increasing order to stage 5, 4, 3 and 2. The 
dotted curves give the equation of state for the models 
A-D and are labelled on the plot. 

tempered. Indeed, if all the ellipses for the data models 
meet in two points (model A being one of them) this is 
mainly due to two assumptions : we have taken the same 
SN distributions (including the same nearby sample) and 
the same systematic errors {Snisyst = 0.02). An important 
effect of these assumptions concerns the orientation of 
the ellipses but realistic survey characteristics allow only 
small rotations of the contours. The strongest effect, 
as mentioned in the previous section, comes from the 
assumed level of systematic errors which is the fundamen- 
tal limitation of the size of the constraints. Then to go 
beyond, a better understanding of the systematic errors 
is mandatory. 

It is possible to represent the result in a different way 
which can be easier for theoreticians. The error on w{z), 
within the Fisher matrix approximation, is given by : 



(1 



+ 2C'woWaCriwo)cr{wa) 



(1 



(5) 



Figure 6 represents the equation of state ■w{z) for the 
different DE models with the error shapes obtained for 
the various data models. 

In this figure, we represent the expected error at 2 cr of 
each survey for a ACDM fiducial model compared with the 
true w{z) of each DE models (A-D). This representation 
is complete and explicitly gives the z dependence of the 
constraints. The four DE models are described with the 



same parameterization and show behaviours outside the 2 
a limit of the error shape of the ACDM model for stages 
4 and 5. They are excluded for different reasons: 

— model A is excluded by the best constraints at the 
pivot redshift, i.e., the best observable to exclude A is 

Wp. 

— model B is excluded by the low z and high z con- 
straints. 

— model C is excluded by the high z (i.e., Wa) behaviour. 

— model D is excluded by the low z (i.e., wq) behaviour. 

The w{z)vsz representation has the advantage to 
visualise the existence of the sweet-spot at the pivot 
point and its impact on the result. Anyway, it shows 
also that it is not possible to use Wp only. For example, 
model A is excluded by the Wp constraints at z = Zp and 
not thanks to the SN discovered at this redshift. This is 
an example of the difficulty of using this information as 
physical. Then, even if this representation is convenient 
its should be taken with some caution. The error shapes 
given by eq.4 are strongly parameterization dependent. 
Consequently, some bias may be present if the chosen 
parameterization {w{z) = wq + Waz/{\ -I- z) in this 
study) is far from reality. In addition, there are strong 
correlations among the cosmological parameters and 
among the redshift bins, and the error shapes of w{z) 
may have some artefacts if not used in a realistic redshift 
range (i.e., the range probed by data). 

Nevertheless, beside the above difficulties this rep- 
resentation may be useful for consistency checks. This 
representation is also sensitive to the systematic errors 
and whatever the parameterization is, one can express the 
constraints and make some data model comparisons. We 
emphasize that it is also possible to provide some results 
in this plane that are independent of any choice of param- 
eterization to describe the DE dynam ics, like the so-called 



"kinematical" approach (see e.g., iDalv fc Diorgovski . 

2004) . This kind of analysis has also some problems 
of interpretation: errors are in general difficult to estimate 
and more noisy, and it does not avoid the correlation 
in redshift bins of the results. However, these various 
approaches are complementary and may be confronted in 
this plane. 

Thus, excluding particular DE models from a cosmo- 
logical constant, require the use of the {wa^Wa) plane 
and/or of the w{z)vsz representation. This is far bet- 
ter than simply comparing Wp with —1. In order to obtain 
more subtle details, like the connection to a particular 
class of DE models or the z dependence of the constraints, 
both representations are useful. For instance, the expres- 
sion of the redshift dependence has some advantages in 
breaking the degeneracy line present in the (wo,Wa) plane. 
Models along this line may be discriminated from a cosmo- 
logical constant by the measurement of the low and high 
redshift behaviour of the equation of state, as encoded in 
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the wq and Wa parameters. But DE models that are or- 
thogonal to the degeneracy line may be excluded by the 
constraints at the pivot redshift, whose expected precision 
depends weakly on the SN survey configuration but more 
on the control of systematic errors. 

The expected interpretation is then very dependent on all 
the details of the design of the SN surveys, and in particu- 
lar very dependent on the level of systematic errors. This 
strategy is also dependent on the chosen parameterization, 
whose effect should also be carefully estimated. 

5. Conclusions 

We have studied, using the DETF figure of merit, the op- 
timisation and interpretation of future supernova surveys 
compared to the forthcoming ground precision. 

We find that the DETF figure of merit is a good ap- 
proach for testing the optimisation of a survey. 

We test this approach by looking at the sensitivity of 
the surveys in term of the number of SN and on the depth 
of the survey with particular attention to the effects of sys- 
tematic errors. The DETF figure of merit is very powerful 
to show the difference in sensitivities of surveys with large 
statistics compared to deep surveys with smaller statistics. 
We show, for example, that adding 1 or 2% of systematic 
errors changes drastically the optimisation and push to in- 
crease the depth rather than the number of objects. This 
conclusion is very strong when not only statistical errors 
are considered, and is not dependant on the kind of sys- 
tematic errors we can consider (e.g., correlated in redshift 
or not). 

More precisely, for 2% of uncorrelated systematic 
errors, we show that there will be no extra information 
for the cosmology with more than 2000 SN and that the 
gain will mainly come from an increase of the depth of 
the survey up to a redshift of 1.7. 

The drawback of the DETF method is the lack of infor- 
mation to estimate the discriminating power among DE 
models, as the central values of the parameters are not 
used. 

Contour plots in the (wo,Wa) plane give a better 
understanding and a good discrimination since classes 
of DE models can be placed in this plane. Comparing 
data models we find that some degeneracies among 
cosmological models remain even for the most ambitious 
project. Complementary information is contained in a 
representation of w{z) with its error shape. This allows 
us to understand the compatibility of the model with the 
different observables, and in particular, to represent the 
redshift dependence of the error. However, the results 
remain in general parameterization dependent and the 
interpretation is challenging. This redshift plane may be 
useful for consistency checks and data model compatibil- 
ity and comparison. 

A solution to improve the sensitivity of the SN analy- 
sis is to combine SN data with other probe information. 



This is certainly powerful as emphasized by the DETF 
but this should be manipulated with some caution as sys- 
tematic errors will dominate the future analyses and will 
introduce even stronger bias in a combination. The best 
test will be to check the compatibility between probes 
when dominated by systematic errors, in a coherent way 
(same theoretical assumptions, same framework, same 
treatment of systematic errors). Combination of probes 
two by two will then help to control systematic effects. 
This will be also a good cross check of the internal 
hypothesis and a control of results. 

Acknowledgments 

Special thanks to A. Tilquin, P. Taxil, C. Marinoni, 
C. Tao, D. Fouchez and A. Bonissent for helpful com- 
ments and suggestions. We also thank the members of the 
"Laboratoire d'Astrophysique de Marseille" for interest- 
ing discussions, in particular A. Mazure, J. -P. Kneib and 
R. Malina. 

References 

Bargcr, V., Guarnaccia, E. & Martafia, D., 2006, Phys. 
Lett.B635, 61 

Caldwell, R.R. & Linder, E.V., 2005, Phys. Rev. Lett. 95, 
141301 

ChevaUier, M. & Polarski, D., 2001, Int. J. Mod. Phys. 
DIO, 213 

Chiba, T., 2006, Phys. Rev.D73, 043501 

C opeland, E.J., Sami, M. & Tsujikawa, S., 2006, 

|hep-th70603057| 
Daly, R.A. & Djorgovski, S.G., 2003, ApJ, 597, 9 
Daly, R.A. & Djorgovski, S.G., 2004, ApJ, 612, 652 
Dark Energy Task Force report to the Astronomy 

and Astrophysics Advisory Committee, 

Ihttp777www.nsf.gov/ mps/ast /detf.jsp 
Hu, W., 2005, ASP^Conf: Ser:;"399;^15 and references 

therein 

Huterer, D. & Turner, M.S., 2001, Phys. Rev. D64, 123527 
Kim, A.G., et al., 2004, MNRAS, 347, 909 
Linder, E.V. & Huterer, D., 2003, Phys. Rev. D67, 081303 
Linder, E.V., 2003, Phys. Rev. Lett. 90, 091301 
Linder, E.V., 2004a, Phys. Rev. D70, 061302 
Linder, E.V., 2004b, Phys. Rev. D70, 023511 
Linder, E.V. & Huterer, D., 2005, Phys. Rev. D72, 043509 
Linder, E.V., 2006a, Phys. Rev. D73, 063010 
Linder, E.V., 2006b, Astropart. Phys. 26, 102 
Martin, D. & Albrecht, A., 2006, astro-ph/06 04401 
Padmanabhan, T., 2003, Phys. Rep. 380, 235 
Peebles, P.J.E. & Ratra, B., 2003, Rev. Mod. Phys. 75, 
559 

Riess, A.G., et al., 2006, [astro-ph/061 1572 
Scherrer, R., 2006, Phys. Rev.D73, 043502 
Simpson, F. & Bridle, S., 2006, Phys. Rev. D73, 083001 
Virey, J.-M., et al., 2004, Phys. Rev. D70, 043514 
Wood-Vasey, W.M., et al., 2004, New Astronomical 
Review 48, 637 



